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In this paper we are concerned with the Holsinger-Gallager model for 
the continuous-time Gaussian channel. Gallager 1 proved a coding theorem 
■for this channel, and Cordaro and Wagner 2 showed that the theorem remains 
valid when the effect of inter symbol interference from previous channel 
uses is taken into account. We show here that the Cordaro-Wagner result 
holds under somewhat weaker hypotheses. Further, the proof here is more 
elementary, since it does not depend on reproducing kernel Hilbert space 
theory. Finally we pose what we feel is an important open problem con- 
cerning the stability of the rnodel. 

I. INTRODUCTION 

In this paper we are concerned with the Holsinger-Gallager model 
Of the continuous-time Gaussian channel. Gallager 1 proved a coding 
theorem for this channel, and Corado and Wagner 2 showed that this 
theorem remains valid when the effect of intersymbol interference from 
previous channel uses is taken into account. We show here that the 
Cordaro-Wagner result holds under somewhat weaker hypotheses. 
Further, our proof is more elementary, since it does not depend on 
reproducing kernel Hilbert space theory. Finally, we pose what we 
feel is an important open problem concerning the stability of the model. 

In the Holsinger-Gallager 1 model, the channel output is 

y {i) = [ h,(t - t)x(t) dr + z(t), - co < t < oo, (1) 

1/ — oo 

where x(t) is the channel input, h^t) is the impulse response of a causal 
linear filter, and z{t) is a sample from a stationary Gaussian process 
with two-sided spectral density N(f). A code (M, T, S, X) for this 
channel is a set of M functions {z<(0}"i witn support on the interval 
[0, T] which satisfy 
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Xi 



= f x%t) dt ^ ST (2) 



(thus S is the allowable average signal "power"), together with a set 

of M disjoint Borel sets {Bi}')' of functions denned on [0, T], such that 
the error probabilities 

P ei 4 Pr{y, ttBi} g X, 1 ^ i g M . (3) 

The random function y t (t){0 ^ t ^ T) is given by (1) with rr-(i) = a\(0. 
Gallager made the following assumptions 

r N(j)df< oo, 

J -00 

£ [ffi(o i 2 # < -, /I ' #$ |2 ^ < *' < 4 > 

where H x (f) = /" hi(t)e~' 2 ' ft dt is the Fourier transform of hi(t). Subject 
to these conditions, Gallager shows that the capacity of the channel 
with allowable average signal power S is 

C = C S = /" max {log Ba \£M I! f | #, ( 5a ) 

where the number J3 S is denned (uniquely) by 

S = f max \b s - . ^ [2 , o} d/. (5b) 

Equations (5) are justified by the following: 

Theorem 1 (Gallager): Let E(R, S) be the error-exponent given by 
Gallager (Ref. 1, Section 8.5). E(R, S) > and continuous, for S > 0, 
and ^ R < C 8 . Then for arbitrary e > 0, S > 0, ^ R < 
C a , there exist codes (M, T, S, \) where (as T -» oo ) 

M ^ e RT and X ^ exp j - (E(R, S) - e)T + o(T)\. 

Now suppose that we wish to use the channel in successive T-second 
intervals. If \Xi{t)\f =l are a set of M code functions with support on 
[0, T], then the channel output for ^ I ^ T will be given by 

V*S) = f K&- r) Xi {r) dr + z(t) 

Jo 

+ E r UT Kit - r)x iK {r - nT) dr, (6) 

n = -oo JnT 

where 1 ^ i, i n ^ M (n = — 1, -2, • • •)• The term 
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• (n+nr 



'(0 = E f M* - r)x in (r - nT) dr 

n = -oo •'nT 



represents intersymbol interference in the interval [0, T] due to signals 
corresponding to previous intervals. We use yf(t) instead of y { (t) to 
indicate the presence of intersymbol interference. With the channel out- 
put given by (6) we can redefine a code (M , T, S, X) as a set of M pairs 
[(Xi(t), B t )}" =1 exactly as above. Here, however, we require [instead 
of (3)] that 

Pr [y*MtBi} ^ \ l^iS.M, (7) 

for all possible f(t). The random function y%(t). is given by (6). 

Cordaro and Wagner 2 succeeded in establishing the validity of 
Gallager's Theorem for this modified model by making the following 
additional assumptions. The first is that 

f [\ log N(j) |/(l + f)]rf/< oo, (8) 

J-OD 

so that N(f) = |Gi(/)| 2 for some Gi(/) with inverse Fourier trans- 
form gi(t) = 0, t < 0. The second assumption is that k x (t) , the inverse 
Fourier transform of #i(/)/Gi(/), is bounded by 

| MO I ^ Ae- Ct , (9) 

for some A, c > 0. 

In Section II we show that the Cordaro- Wagner result holds with 
condition (9) replaced by the following essentially weaker condition: 
By (8) we can find a G(f) such that N(f) = |G(/)| 2 and the linear 
filters corresponding to G(f) and its inverse are causal. 3 Let k(t) be 
the inverse Fourier transform of #i(/)/(r(/). Then the new condition 
is that for t sufficiently large 

I Kt) \Sjr,, (90 

for some A, /? > 0. Note that by (4) 

f [| #,(/) |7 W)] df = fk\t)dt< =c, 

so that (9') is not a very strong additional assumption. 
An Open- Problem: In order to achieve the error probability guaranteed 
by Theorem 1 or in fact simply a vanishing error probability (as T — > oo ) 
for R < C s , Gallager's proof requires the receiver to make arbitrarily 
precise measurements (see for example Lemma 8.5.1 in Ref. 2). A 
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practical system, however, imposes certain limitations on the accuracy 
with which we can make measurements. Therefore a reasonable require- 
ment for the decoding regions {5,-}f is the following: 

Vl e B t , y 2 e Bi (i * j) => \ j' [(y,(0 - y 2 (t))T dt > v, (10) 

for some v > 0. Thus v is a measure of the accuracy of the measure- 
ments at the decoder. The channel capacity will therefore depend on v, 
say C s {v). A quantity of interest might be iim„_ C s (p). Whether or not 
this quantity is the same as C s in (5) is an open question. 

II. PROOF OF THE MAIN RESULT 

Let us consider first the problem with no interference from previous 
channel uses when the input x(t) has support on the interval [0, T\. 
Gallager (Lemma 8.5.1, p. 413) shows that knowledge of the function 
y(t), ^ t ^ T, is equivalent to knowledge of a certain vector v = 
(vx , v 2 , • • •)• This vector v can be represented by 

v = u + z, (11) 

where z is a sequence of statistically independent standard Gaussian 
variates, and the vector u is defined as follows. Let 

u(t) = f k(t - t)x{t) dr, t ^ 0, (12) 

where k(t) is defined in Section I and x(t) is the channel input. Let S be 
the subspace of £ 2 (— °°, °°) spanned by the orthonomal functions 
{0,(0}" defined on p. 416 of Ref. 2. Let P s (u) be the projection of u{t) 
on the subspace S. Then u = (ui , u 2 , • • •), where u k is the coefficient 
of 6 k (t) in the expansion of P&(u) in the basis {0,(0 1" . 

We will not need any properties of the 0, (0 except for the fact [which 
follows from the causality of the filters corresponding to G(f) and 
Hi(j)/G(j)} that 0,(0 has support on the interval [0, T\. 

Let {Xi(t)}" be a set of code signals with parameters S = Si and 
T = 7\ . Let u, be the u corresponding to x(t) = x { {t), and let v, = 
u, + z. Then if the minimum-distance decoder is used, 

P ti = Pr {</,*■£,} =Pr Utllv.-u, || ^ ||v, - u, ||] 
= Pr UtlMI ^ ||z-(u,-u..)||] 
= Pr U [<»,«* -u,>^i||u,-- U< || 2 J, (13) 
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where "|| ||" denotes Euclidean norm and "< , >" denotes inner product. 
In particular, 

P ti = Pr \ViiBi] ^ Pr «i,u, -U,> ^ | || u,- - u, || 2 } 

= * e (i ||u y -u, ||), J9*i, (14) 

where $ e Qi) = J" (2«")~*e~ ,V2 diy, the complementary error function. 
Now, let us suppose that we are given a code (M, 7\ , Si , X,), 
\(xi(t), B { )}" for the no-interference model. We can assume that 
the Bi correspond to the minimum-distance decoder. We now form a 
new code |(s*(0, B*i)}" with parameters T = T 2 = (1 + 8)T 1 and 
S = S 2 = aSi/(l + 5) for use on the channel with intersymbol inter- 
ference (6). We set 

xf(l) = U(0, oi^r,, (15) 




ri < * ^ (i + s)^ = t 



2 I 



where a > 1 and 5 > are arbitrary. Note that we have allowed a 
guard band of width 57\ between channel inputs. We will specify the 
decoding sets B* t below, mentioning here only that the decoder will 
observe the received waveform y*(t) only for ^ t ^ 7\ . 

We can discretize the channel exactly as above and consider the 
channel output (when a-*(0 is the input) to be given by the vector 

v* t = au, + z + u, (16) 

where u, and z are exactly as in (11) and u (which represents the effect 
of previous channel uses) is the vector whose coordinates are the coeffi- 
cients in the expansion of P s (u(t)) in the {0,(0} , and 

u(t) = £ f" T k(i - t)xUt - nT) dr = £ u n (t), (17) 

r ■ -oo "nT n = -oo 

where 1 ^ i n ^ M. 

The decoding regions B* { will correspond to the minimum-distance 
decoder, i.e., y* t B* if the corresponding v is closer in Euclidean norm 
to au, than to all au, 0" ?■* ?). Thus for a given u, 

Pr [yf^Bf) = Pr \J \\\ v* - au,- || ^ || vf - au,- ||}. 

Now let e, S, > 0, and R(0 ^ R < C S1 ) be given, and let 
the (M, Ti , Si , \i) code { (r, , J3,-) ) ", discussed above, be a set of codes 
which satisfy Theorem 1; that is, 

M ^ e Rr ' and X, ^ exp { - (E(R, S,) - e)7\ + 0l (7\)}. 
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We will show that for T^ sufficiently large, the derived code has 
parameter A ^ Ai . Thus we will have found a set of codes (M, T 2 , 
S-z , a) for the model with intersymbol interference with 

s > = (iTi)' Ma -p{(rfi) T ' 

and 

J (E(R, &) - e ) T o t (T a ) 

Since #(#, £) is continuous and or may be chosen arbitrarily close to 1 
and 5 arbitrarily close to zero, we will have established Theorem 1 for 
the intersymbol interference case which is our main result. Thus it 
remains to establish that the error probability for the derived code ^ X, . 
We will do this by showing that (for 7\ sufficiently large) for each 
i = I, 2, • • ■ , M and all possible f(t), 

Pr{y*(t)tBT) £ft{y(0*£<}- (18) 

Inequality (18) will follow directly from the following lemmas (the 
proofs of which conclude this section) . 
Lemma 1: Inequality (18) is satisfied, if 

||*|| £ (a ~ ^minHu, -u, ||. (19) 

Lemma 2: For the codes {(&, , Bi))f =1 , as 7\ — > », 
min ||Ui -u, || 2 ^ 0(7\). 

•V; 

Lemma 3: As 7\ -* «, || u || 2 ^ 0(7r 2 *). 

From Lemmas 2 and 3, condition (19) in Lemma 1 will be satisfied 
for 7\ sufficiently large. Thus so will (18) be satisfied for T x sufficiently 
large. 

Proof of Lemma 1: Since B { and B% are the minimum-distance decoders, 
the left member of (18) is 

Pr \yfiBf) = Pr \J [\\ v? - «u, || ^ || vf - all, |||. (20) 

The right member of (18), Pr \y { 4 B t \ is given by (13). Consider the 
event 

{|]v.-*-«u,- || ^ || v,*- cm, ||} 

- {<z+*,u, -u,)*|||u, -tt, || 8 V (21) 
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But by the hypothesis of Lemma 1 (19), 

i<4l: 

2 
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<u,u,- - u.) I ^ ||u 11-11 u,- - u, || g -^ — || u. u, 



Thus the event in (21) 

c{( Z) u J .-u,)^|||u,.-u 1 || 2 -^||u,.-u,- 

= {<z,u, -u ( >miiu, -u.-m, 

Lemma 1 now follows from (20), (13) and the above. 
Proof of Lemma 2: For the codes { (x { , B,)\", 

Pr [ViiBA ^ exp f- (E(R, S) - e)T t + o(7\))i, 

so that from (14) 

*„(* II u, - u, ||) ^ exp j- (E(R, S) - e)7\ + o(T t )}. 

Since, as £ -» *, *.($) = e - (tV2)(1+0(1)) , we have 

|| u,- - u,|| 2 ^ S(E(R,S) - e)7\ + o(T } ), 

which implies Lemma 2. 

Proof of Lemma 3: Let 0(0 t S be the function colinear with P & (u(t)) with 
unit length in £ 2 norm. That is 6(t) = P s (w)/|| P s (u) \\ , where "|| ||" 
applied to functions is the £ 2 norm. Then 

II a || = || p s 4, \\ = \ f e{t)u{t)dt 

But since all functions in S and therefore 6(t) have support on [0, T 7 ,], 

||ft || - J Q Tl e(t)2i(t) dt I g \\6 || [/^'^(O d«J* 

= [/^ ft«(0 rf/]* ^ JE [{'" *0 <*<]', (22) 

where w„(0 is defined in (17). 

Consider first the n = —1 term in the above summation. For 
£ t ^ T t , 

| £_,(*) I 2 - a 8 f fc(J - r)a-,_,(T + r 8 ) dr 



ga 2 [ ' k\t - r)dr f ' .T*_,(r + T 2 ) dr 
g a'S.T, j* V(< - r) dr. 
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Changing the variable of integration to w = t — t, we have 
= a 2 S l T l [ ' k\w) dw. 

Jt + tTt 

From condition (&) , for sufficiently large T x , 

Jt+STv w Jjr ' w 

_ afSjTjA 2 , „, >.-i- 2 fl _ a A Si y,-2fl 

~ 1 + 2/3 {dll) (l + 2/3)(5) 1+2fl ' ' 

and therefore 

r ^i« ^ ^ , a2A2s \ +2 * «-* ■ ^ 

Jo (1 + 2/3) 5 1+2 " 

Next consider -2 ^ n > — ». For ^ £ £» T 7 , , paralleling the 
above steps we obtain 

/b 2 (< - r)dr \ xl(r - nT 2 ) 

g a 2 S 1 T l / /c» dw, 

where n' = — n. Again applying condition (90, we have 



di 



<UQ | 2 ^ a 2 S,7\ £ 






1 + 2/3 L(n / r 2 ) ,+2 " [(n' + l)r a ] ,+a "J 

TtA* r_i i l 

+- 8 y^Ti 1+2fi l(nT 2P (n' + l) 1+2 "-J 



o?S 

(1 + 2/3)(l + 

a 2 S t A 2 



&.. • 



(1 + 2/3) (1 + S) 1+a 'T 8 ' " 

The important fact here is that as n' -» » , &„. = 0(n /_(2+ ^ > ). Therefore, 
the integral 

Jo (i + 2/3) (i + a) 1+2 ' 

Substituting (23) and (24) into (22) we have, 
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||* || £ Ti-'a^^^yfY*-' + (1 + 5)-*-" ± «.]■ 

Since the summation converges, we have || ii |j 2 ^ 0(T\~ 2B ), which is 
Lemma 3. 
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